An Investigation into the Performance of Ethnicity Verification Between Humans and Machine Learning Algorithms

There has been a significant increase in the interest for the task of classifying demographic profiles i.e. race and ethnicity. Ethnicity is a significant human characteristic and applying facial image data for the discrimination of ethnicity is integral to face-related biometric systems. Given the diversity in the application of ethnicity-specific information such as face recognition and iris recognition, and the availability of image datasets for more commonly available human populations, i.e. Caucasian, African-American, Asians, and South-Asian Indians. A gap has been identified for the development of a system which analyses the full-face and its individual feature-components (eyes, nose and mouth), for the Pakistani ethnic group. An efficient system is proposed for the verification of the Pakistani ethnicity, which incorporates a two-tier (computer vs human) approach. Firstly, hand-crafted features were used to ascertain the descriptive nature of a frontal-image and facial profile, for the Pakistani ethnicity. A total of 26 facial landmarks were selected (16 frontal and 10 for the profile) and by incorporating 2 models for redundant information removal, and a linear classifier for the binary task. The experimental results concluded that the facial profile image of a Pakistani face is distinct amongst other ethnicities. However, the methodology consisted of limitations for example, low performance accuracy, the laborious nature of manual data i.e. facial landmark, annotation, and the small facial image dataset. To make the system more accurate and robust, Deep Learning models are employed for ethnicity classification. Various state-of-the-art Deep models are trained on a range of facial image conditions, i.e. full face and partial-face images, plus standalone feature components such as the nose and mouth. Since ethnicity is pertinent to the research, a novel facial image database entitled Pakistani Face Database (PFDB), was created using a criterion-specific selection process, to ensure assurance in each of the assigned class-memberships, i.e. Pakistani and Non-Pakistani. Comparative analysis between 6 Deep Learning models was carried out on augmented image datasets, and the analysis demonstrates that Deep Learning yields better performance accuracy compared to low-level features. The human phase of the ethnicity classification framework tested the discrimination ability of novice Pakistani and Non-Pakistani participants, using a computerised ethnicity task. The results suggest that humans are better at discriminating between Pakistani and Non-Pakistani full face images, relative to individual face-feature components (eyes, nose, mouth), struggling the most with the nose, when making judgements of ethnicity. To understand the effects of display conditions on ethnicity discrimination accuracy, two conditions were tested; (i) Two-Alternative Forced Choice (2-AFC) and (ii) Single image procedure. The results concluded that participants perform significantly better in trials where the target (Pakistani) image is shown alongside a distractor (Non-Pakistani) image. To conclude the proposed framework, directions for future study are suggested to advance the current understanding of image based ethnicity verification.Acumé Forensi

Inter-Ethnic and Demic-Group Variations in Craniofacial Anthropometry: A Review

yesCraniofacial anthropometry plays an important role in facial structure. This review paper evaluates existing research surrounding population norms of studied facial parameters. The purpose is two-fold: (1) to determine variations in facial measurements due to demi-group or ethnic variations based on traditional (direct) caliper based and image based (indirect) anthropometric methods. (2) to compare where possible, measured facial parameters between referenced studies. Inter and intra-population variations in addition to sexual dimorphism of facial parameters such as the nose and eyes, singularly or in combination with one another, have been concluded. Ocular measurements have exhibited ethnic variations between males and females of the Saudi, Turkish, Egyptian and Iranian group. Moreover, demic variations are reported when the native language has been used a key criterion. It has been concluded that with the current state of migration and inter-demic marriages, the study of homogenous populations will prove difficult. Subsequently, this will result in ambiguous physical traits that are not representative for any one demic or ethnic population. In this paper, results for the following adult male and female populations have been discussed: African American, Azerbaijani, Caribbean, Chinese, Croatian, Egyptian, Italian, Iranian, Turkish, Saudi Arabian, Syrian and South African. The qualitative research presented serves as a knowledge base for learners and strikes up thought provoking concepts about the direction anthropometrical research is heading

Standardising the Capture and Processing of Custody Images

yesCustody images are a standard feature of everyday Policing and are commonly used during investigative work to establish whether the perpetrator and the suspect are the same. The process of identification relies heavily on the quality of a custody image because a low-quality image may mask identifying features. With an increased demand for high quality facial images and the requirement to integrate biometrics and machine vision technology to the field of face identification, this research presents an innovative image capture and biometric recording system called the Halo. Halo is a pioneering system which (1) uses machine vision cameras to capture high quality facial images from 8 planes of view (including CCTV simulated), (2) uses high quality video technology to record identification parades and, (3) records biometric data from the face by using a Convolutional Neural Networks (CNN) based algorithm, which is a supervised machine learning technique. Results based on our preliminary experiments have concluded a 100% facial recognition rate for layer 34 within the VGG-Face model. These results are significant for the sector of forensic science, especially digital image capture and facial identification as they highlight the importance of image quality and demonstrates the complementing nature a robust machine learning algorithm has on an everyday Policing process

A machine learning approach for ethnic classification: the British Pakistani face

NoEthnicity is one of the most salient clues to face identity. Analysis of ethnicity-specific facial data is a challenging problem and predominantly carried out using computer-based algorithms. Current published literature focusses on the use of frontal face images. We addressed the challenge of binary (British Pakistani or other ethnicity) ethnicity classification using profile facial images. The proposed framework is based on the extraction of geometric features using 10 anthropometric facial landmarks, within a purpose-built, novel database of 135 multi-ethnic and multi-racial subjects and a total of 675 face images. Image dimensionality was reduced using Principle Component Analysis and Partial Least Square Regression. Classification was performed using Linear Support Vector Machine. The results of this framework are promising with 71.11% ethnic classification accuracy using a PCA algorithm + SVM as a classifier, and 76.03% using PLS algorithm + SVM as a classifier